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1 1. A system for computing optical flow between 

2 images within an image sequence comprising: 

3 an image processor processing the image sequence, 

4 wherein the image processor: 

5 derives epipolar geometry for the images 
ft from point matches between the images; and 

computes optical flow for each pixel within 

{jh at least one of the images under a constraint derived 

SMi from the epipolar geometry. 

t j 2. The system according to claim 1, wherein the 

3f! image processor, in deriving the epipolar geometry for the 

3 images, computes sparse optical flow between the images. 

1 3. The system according to claim 1, wherein the 

2 image processor, in computing optical flow for each pixel 

3 within at least one of the images, employs a constraint 

4 derived from a fundamental matrix between the images. 
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4. The system according to claim 1, wherein the 
image processor utilizes the constraint derived from the 
epipolar geometry in combination with least squares 
minimization to compute optical flow for each pixel within 
at least one of the images, 

5. The system according to claim 1, wherein the 
image processor utilizes the constraint derived from the 
epipolar geometry in combination with robust statistical 
methods to compute optical flow for each pixel within at 
least one of the images. 

6. The system according to claim 1, wherein the 
image processor computes optical flow u,v for each pixel 

within at least one of the images from I x ii + I y v + I t = 0 , where 
I x , I f and I t are known spatio-temporal derivatives of 
image intensity at each pixel within the at least one 
image , and a x y u + b xy v + c xy = 0 , where a xy , b x y and c x y are 
derived from a fundamental matrix F between the images. 

7. The system according to claim 1, wherein the 
image processor computes dense optical flow between the 
images . 
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1 8. A system for computing optical flow between 

2 images within an image sequence comprising: 

3 a video receiver including an input for receiving 

4 the image sequence; 

5 an image processor within the video system 

6 processing the image sequence, wherein the image processor: 

7 derives epipolar geometry for the images 
EE from point matches between the images; and 

cfi computes optical flow for each pixel within 

l<jp at least one of the images under a constraint derived 

1 from the epipolar geometry. 

jy 9. The system according to claim 8, wherein the 

|: image processor, in deriving the epipolar geometry for the 

3 images, computes sparse optical flow between the images. 

1 10. The system according to claim 8, wherein the 

2 image processor, in computing optical flow for each pixel 

3 within at least one of the images, employs a constraint 

4 derived from a fundamental matrix between the images. 
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1 11. The system according to claim 8, wherein the 

2 image processor utilizes the constraint derived from the 

3 epipolar geometry in combination with least squares 

4 minimization to compute optical flow for each pixel within 

5 at least one of the images. 

1 12. The system according to claim 8, wherein the 

image processor utilizes the constraint derived from the 
3j; epipolar geometry in combination with robust statistical 

4™ methods to compute optical flow for each pixel within at 

least one of the images. 

13. The system according to claim 8, wherein the 

"IK? i 

2M image processor computes optical flow u,v for each pixel 

3 within at least one of the images from Iu + I v v + I=0 , where 

x y t 

4 I x , I y , and I t are known spatio-temporal derivatives of 

5 image intensity at each pixel within the at least one 

6 image , and a xy u + b x y v + c x ^ y = 0 , where a x>y , b x y and c x> are 

7 derived from a fundamental matrix F between the images . 

1 14. The system according to claim 8, wherein the 

2 image processor computes dense optical flow between the 

3 images . 
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15. A method for computing optical flow between 
images within an image sequence comprising: 

deriving epipolar geometry for the images from 
point matches between the images; and 

computing optical flow for each pixel within at 
least one of the images under a constraint derived from the 
epipolar geometry. 



16. The method according to claim 15, wherein the 
step of deriving the epipolar geometry for the images from 
point matches between the images further comprises: 

computing sparse optical flow between the images. 

17. The method according to claim 15, wherein the 
step of computing optical flow for each pixel within at 
least one of the images under a constraint derived from the 
epipolar geometry further comprises: 

computing optical flow employing a constraint 
derived from a fundamental matrix between the images. 
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18. The method according to claim 15, wherein the 
step of computing optical flow for each pixel within at 
least one of the images under a constraint derived from the 
epipolar geometry further comprises: 

utilizing the constraint derived from the 
epipolar geometry in combination with least squares 
minimization to compute optical flow for each pixel within 
at least one of the images. 

19. The method according to claim 15, wherein the 
step of computing optical flow for each pixel within at 
least one of the images under a constraint derived from the 
epipolar geometry further comprises: 

utilizing the constraint derived from the 
epipolar geometry in combination with robust statistical 
methods to compute optical flow for each pixel within at 
least one of the images. 
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20. The method according to claim 1, wherein the step 
of computing optical flow for each pixel within at least 
one of the images under a constraint derived from the 
epipolar geometry further comprises: 

computing optical flow u,v for each pixel within 
at least one of the images from I x u + I y v + I t - 0 , where I x , I 
and I t are known spatio-temporal derivatives of image 
intensity at each pixel within the at least one image, and 
a x,y u + Ky v + c x, y =Q * where a xy , b xy and c xy are derived from a 
fundamental matrix F between the images. 



